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METHOD OF REALIZING COMMANDS SYNCHRONIZATION 
IN SUPPORTING MULTI-THREADING NON-VOLATILE MEMORY FILE 

SYSTEM 



5 BACKGROUND 

[0001] A file system of a non-volatile memory may be organized as a 

directory-file structure, such as a tree-shaped structure. A root of the tree may 
be a root directory. Going through the tree, the root directory may be 
associated with one or more directories and then the directories may be 

1 0 associated with one or more files. Each directory or file may have one or more 

sectors that may be dynamically allocated in the non-volatile memory at 
different locations. The sectors may be linked by a data structure, such as a 
sequence table. If there are multiple concurrent read/write commands on the 
same file or directory, a lower priority read/write may be pre-empted by a 

1 5 higher priority write. The higher priority write may move the sequence table to 

a new physical location (like replacement), after the higher priority write 
completes. However, the lower priority read/write command may not know 
the new location of the sequence table. A similar situation occurs for multiple 
writes on different files that may cause the parent directory location change. 



20 BRIEF DESCRIPTION OF THE DRAWINGS 

[0002] The invention described herein is illustrated by way of example and not 

by way of limitation in the accompanying figures. For simplicity and clarity of 

illustration, elements illustrated in the figures are not necessarily drawn to 

scale. For example, the dimensions of some elements may be exaggerated 

25 relative to other elements for clarity. Further, where considered appropriate, 
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reference labels have been repeated among the figures to indicate 
corresponding or analogous elements. 
[0003J FIG. 1 illustrates an embodiment of a file system of a non-volatile 
memory. 

[0004] FIG. 2 illustrates an embodiment of an information fragment in a file 

system of a non-volatile memory. 
[0005] FIG. 3 illustrates an embodiment of a sequence table, in a file system of 

a non-volatile memory. 
[0006] FIG. 4 illustrates an embodiment of a data structure, such as a track 

table and corresponding lists attached to the track table. 
[0007] FIG. 5 illustrates an embodiment of a system of the present invention. 
[0008] FIG. 6 is a flowchart illustrating an embodiment of a method that may be 

used to read a file or a directory of a non-volatile memory. 
[0009] FIG. 7 is a flowchart illustrating an embodiment of a method that may be 

used to write a file or a directory of a non-volatile memory. 

DETAILED DESCRIPTION 

[001 0] The following description describes techniques for realizing commands 
synchronization in supporting a non-volatile memory file system, for example 
multi-threading flash file system. In the following description, numerous 
specific details such as logic implementations, opcodes, means to specify 
operands, resource partitioning/sharing/duplication implementations, types 
and interrelationships of system components, and logic 
partitioning/integration choices are set forth in order to provide a more 



thorough understanding of the present invention. However, the invention may 
be practiced without such specific details. 
[001 1 ] References in the specification to "one embodiment", "an embodiment", 
"an example embodiment", etc., indicate that the embodiment described may 
include a particular feature, structure, or characteristic, but every 
embodiment may not necessarily include the particular feature, structure, or 
characteristic. Moreover, such phrases are not necessarily referring to the 
same embodiment. Further, when a particular feature, structure, or 
characteristic is described in connection with an embodiment, it is submitted 
that it is within the knowledge of one skilled in the art to effect such feature, 
structure, or characteristic in connection with other embodiments whether or 
not explicitly described. 

[001 2] Referring now to Fig. 1, a file system 1 00 of a non-volatile memory may 
comprise, for example, a tree-shaped directory-file structure. In one 
embodiment, file system 100 may comprise a root directory 110. Root 
directory 1 10 may comprise a root directory information fragment 1 12. In 
another embodiment, file system 100 may further comprise a directory120; 
however, other embodiments may comprise a different number of directories. 
In another embodiment, file system 100 may comprise more levels of 
directories. Directory 120 may comprise a directory information fragment 122. 
In one embodiment, root directory information fragment 1 12 may comprise 
one or more entries that may each be associated with a directory information 
fragment. For example, entry 114 may comprise a pointer that may point to 
directory information fragment 122. In one embodiment, the pointer may point 
to a first sector of directory information fragment 122. 



[001 3] In one embodiment, file system 1 00 may further comprise a file 1 30; 
however, other embodiments may comprise a different number of files. For 
example, file 1 30 may comprise a file information fragment 1 40. Directory 
information fragment 122 may comprise an entry 124 that may be associated 
with file information fragment 1 40; however, other embodiments may 
comprise a different number of entries. For example, entry 124 may include a 
pointer that may point to the file information fragment 140, e.g., a first sector 
of file information fragment 140. In one embodiment, file 130 may further 
comprise zero or more sequence table, for example, a sequence table may 
be implemented using various data structures, such as lists, arrays, etc. In 
one embodiment, file 1 30 may comprise a root sequence table with zero or 
more child sequence tables, to accommodate different number of file data 
fragments. For example, FIG. 1 shows that file 1 30 comprise a root sequence 
table 1 50 with two child sequence tables 160a and 160b. In one embodiment, 
a sequence table may comprise one or more sectors. 
[0014] Referring to FIG. 1 , in one embodiment, file information fragment 140 
may comprise an entry 141 that may be associated with root sequence table 
150. For example, entry 141 may comprise a pointer that may indicate the 
location of root sequence table150, e.g., a first sector of root sequence table 
150. In another embodiment, file information fragment 140 may comprise one 
or more entries (for example, pointers) that may each point directly to a 
corresponding file data fragment, for example, file data fragments 171-176, if 
there is no need for a sequence table since the number of entries in file 

information fragment 140 is not less than that of the file data fragments in file 
130. 



[001 5] In another embodiment, root sequenced table 1 50 may comprise one or 
more entries that may each be associated with a child sequence table. For 
example, root sequence table 150 may comprise entries 151 and 152 that 
may be associated with child sequence tables 160a and 160b, respectively. 
In another embodiment, root sequence table 150 may comprise one or more 
entries that may each be associated with a corresponding file data fragment, 
if there is no need for a child sequence table since the number of entries in 
root sequence table 150 is not less than that of the file data fragments in file 
130. In yet another embodiment, each of entries 151 and 152 may include a 
pointer that may indicate the locations of child sequence tables 1 60a and 
1 60b, respectively. For example, a pointer may point to a first sector of a child 
sequence table. 

[0016] With reference to FIG. 1 , file 130 may comprise one or more file data 
fragments, for example, file data fragments 171-176. In one embodiment, 
child sequence tables 160a and 160b may comprise entries that may each be 
associated with file data fragments 171-176, respectively. For example, child 
sequence tables 160a and 160b may comprise pointers that may each 
indicate a location of a corresponding one of file data fragments 171-176. 
Although FIG. 1 shows that file 130 may comprise a root sequence table and 
two child sequence table, in other embodiments, file system 1 00 may 
comprise a root sequence table and one or more child sequence table for a 
root directory or a directory to accommodate more directories and files, 
respectively. In another embodiment, file system 100 may comprise multi 
levels of child sequence tables. 



[001 7] Referring now to FIG. 2, an embodiment of an information fragment 200 

is shown. For example, information fragment 200 may include root directory 

information fragment, directory information fragment or file information 

fragment. In one embodiment, information fragment 200 may comprise one 

or more sectors that may be continuous. In another embodiment, information 

fragment 200 may comprise a data structure of one or more entries 230 that 

may each indicate a location of a corresponding fragment that links to 

information fragment 200. For example, each of entries 212, 214 and 216 

may comprise a pointer that may point to a fragment or a root sequence table 

(e.g., a first sector thereof) attached to information fragment 200; however, in 

other embodiments, information fragment 200 may comprise a different 

number of entries. For example, root directory information fragment 112 of 

FIG. 1 may comprise entry 114 (for example a pointer) that may be 

associated with directory information fragment 122. In another embodiment, 

information fragment 200 may comprise one or more blank entries reserved 

for future entries. For example, blank entries may follow existing entries. In 

yet another embodiment, information fragment 200 may comprise one or 

more entries that may have the same index or serial number. For example, 

entries 212, 218 and 222 may have the same serial number, such as "1". The 

last entry 222 of the three may be considered as a valid latest entry and 

entries 212 and 218 may be considered as invalid. Similarly, entries 214 and 

220 may have the same serial number "2". The last entry 220 may be 

considered as a valid latest entry and entry 214 may be considered as invalid. 

[001 8] Referring to FIG. 3, an embodiment of a sequence table 300 is shown. 

For example, sequence table 300 may include root sequence table or child 
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sequence table. In one embodiment, sequence table 300 may comprise one 
or more sectors that may be continuous. In another embodiment, sequence 
table 300 may comprise a data structure, such as lists, arrays, etc. For 
example, sequence table may comprise a first field 310 and a second field 
320 to indicate linkage among fragments. For example, referring to FIG. 1 , file 
data fragments 171-176 may link to file information fragment 140 via root 
sequence table 150 and child sequence tables 160a and 160b, wherein root 
sequence table 150 is a parent sequence table. 
[0019] In one embodiment, the first field 310 may comprise a replacement 
pointer field and the second field 320 may comprise a location pointer field. In 
another embodiment, the second field 320 may indicate a location of a 
fragment or a child sequence table that may attach to sequence table 300. 
The first field 310 may represent a location of a new entry that updates an 
existing entry of the second field 320. For example, entry 321 of the second 
field 320 may comprise a location pointer 1 that is associated with an existing 
fragment. If the existing fragment is replaced by a new fragment or moved to 
a new location, entry 312 of the first field 310 may comprise a first 
replacement pointer that may point to entry 324, which may comprise a first 
new location pointer to the new fragment or new location to replace the first 
location pointer of entry 321 . Moreover, entries 322 and 323 of the second 
field 320 may comprise a second and a third location pointers, respectively, 
that may each point to a fragment. Entry 314 of the first field 310 may 
comprise a third replacement pointer that may point to entry 325, which may 

comprise a third new location pointer to replace the third location pointer of 
entry 323. 
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[0020] Now referring to FIG. 4, an embodiment of a data structure 400 is 
shown. Data structure 400 may store information or primary information on 
one or more files and/or one or more directories being operated concurrently. 
Data structure 400 may be implemented in various forms, such as lists, 
arrays, etc. In one embodiment, the information may be used to identify the 
one or more files or directories. Referring to FIG. 4, a first element 416 may 
relate to a file and a second element 418 may relate to a directory. In one 
embodiment, data structure 400 may comprise a track table. In another 
embodiment, data structure 400 may comprise one or more fields, such as 
fields 41 1-415. For example, for each element, a first field 41 1 may comprise 
an identifier that may identify a file or directory that is operated by one of the 
concurrent operations; a second field 412 may indicate a location associated 
with the file or directory, for example, a location of a root sector or a first 
sector of the file or directory; a third field 413 may comprise an attribute that 
may indicate a type of the file or the directory; a fourth field 414 may indicate 
a number of elements in a list (for example, 420 or 430) associated with the 
file or the directory, such as a number of concurrent operations on the file or 
the directory; and a fifth field 415 may comprise a link to the list, such as an 
address or a pointer to a first element in the list. However, other embodiments 
may comprise different fields to accommodate different primary information. 
In another embodiment, data structure 400 may be dynamically allocated in a 
volatile memory. The number of elements in data structure 400 may depend 
on how many files or directories being operated, such as read or written, 
simultaneously. 
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[0021] FIG. 4 further shows an embodiment of a first list 420 and a second list 

430 that may correspond to the first element 41 6 and the second element 41 8, 

respectively. In one embodiment, the first and second lists 420 or 430 may 

comprise various types of data structures, such as signal linked lists, double 

linked lists, arrays, vectors, etc. The first list 420 may comprise one or more 

elements to track progress of all concurrent operations on the same file that is 

indicated by element 416. In one embodiment, the first list 420 may comprise 

elements 421-423 that may be associated with operations, READ 1 , READ 2 

and WRITE 1 , respectively; however, other embodiments may comprise a 

different number of elements to accommodate a different number of 

operations and may apply to different operations. In another embodiment, the 

first list 420 may be dynamically stored in a volatile memory and elements 

421-423 may be dynamically allocated at different addresses of the volatile 
memory. 

[0022] Referring to FIG. 4, in one embodiment, each element of the first list 
420 may comprise a progress information or data field 424 that may comprise 
progress information or progress data about one of the concurrent operations, 
for example, locations or pointers of sectors being operated in the operation. 
For example, said sectors may belong to one or more information fragments 
or sequence tables. In another embodiment, said sectors may comprise a 
first sector of one or more information fragments or sequence tables. Each 
element of the first list 420 may further comprise link information or data field 
or a next element location field 426 that may link one or more elements, for 
example 421-423, relating to the same file or directory. For example, the next 

element location field 426 may comprise an address or a pointer to a next 
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element in the first list 420. For example, the next element pointer field 426 
may indicate an address of a volatile memory where an element on a next 
operation is stored. For example, the first element 421 of the first list 420 may 

— * 

comprise locations of sectors being read in READ 1 and an address 1 
associated with the next operation READ 2. In another embodiment, the last 
element 423 may comprise locations of sectors being written in WRITE 1 with 
a null next element location field, because there is not any next operation in 
the first list 420. Similarly, the second list 430 associated with a directory that 
is indicated by element 418 may comprise information of operations on the 
directory. The description on the second list 430 may refer to that of list 420, 
and thus is omitted herein. Although the first and second lists 420 and 430 are 
illustrated as separated from data structure 400, in other embodiments, 
elements of each list may be included in data structure 400. 

[0023] Now Referring to FIG. 5, a diagram of a system level overview 

according to one embodiment of the present invention is illustrated. As shown 
in FIG. 5, the system 500 includes a processor 510, a non-volatile memory 
520 and a volatile memory 530. Processor 510 may be any type of processor 
adapted to perform operations in non-volatile memory 520 or volatile memory 
530. For example, processor 510 may be a microprocessor, a digital signal 
processor, a microcontroller, or the like. 

[0024] Non-volatile memory 520 may comprise non-volatile memory, or the 
like. Processor 51 0 and non-volatile memory 520 may be coupled by bus 51 5. 
Volatile memory 530 may comprise RAM, or the like. Processor 510 and 
volatile memory 530 may be coupled by bus 525. In one embodiment, 
processor 510, non-volatile memory device 520 and the volatile memory 530 
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may be included on an integrated circuit board, and buses 515 and 525 may 
be implemented using traces on the circuit board. In another embodiment, 
processor 510, non-volatile memory 520 and the volatile memory 530 may be 
included within the same integrated circuit, and buses 515 and 525 may be 
implemented using interconnect within the integrated circuit. 

[0025] Processor 510 may perform operations in non-volatile memory 520 or 
volatile memory 530. In one embodiment, processor 510 may perform 
operations in the method as shown in Figs. 6 and 7, which will be described in 
the following paragraphs. In one embodiment, processor 510 may be not 
dedicated to the use of non-volatile memory 520, and processor 510 may 
perform operations in non-volatile memory 520 or volatile memory 530 while 
also performing other system functions. 

[0026] An example method is illustrated in FIG. 6 that may be used by 

processor 510 to read a file or a directory from non-volatile memory 520. In 

one embodiment, processor 510 may establish in volatile memory 530 a data 

structure, such as 400, that may comprise one or more elements, wherein 

each element may record primary information on a file or a directory being 

operated. In another embodiment, processor 510 may build up in the volatile 

memory one or more lists, such as 420 and 430, that may be attached to each 

element of the data structure 400 and may comprise progress information on 

all concurrent operations on the file or the directory identified by each element. 

In yet another embodiment, instead of using one or more lists, processor 510 

may combine elements in lists 420 and 430 in data structure 400 for all 

concurrent operations. The following description on the method of FIG. 6 may 

make reference to the embodiment of FIG. 4; however, other embodiments 
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may adopt different data structures to track information on each concurrent 
operation. 

[0027] In block 602, processor 510 may create a new element for a READ 
operation, for example, READ 1. Referring to the embodiment of FIG. 4, 
processor 510 may create in data structure 400 a new element 416 that may 
comprise information on a file, for example file A, being operated in READ 1 , 
in response to determining that data structure 400 does not comprise an 
element regarding file A. In another embodiment, processor 510 may create 
in the first list 420 a new element 421 for READ 1 that may read one or more 
sectors of file A. Element 421 may be attached to element 416 of data 
structure 400. In yet another embodiment, processor 510 may combine 
elements 416 and 421 in the same data structure 400. In block 604, 
processor 510 may initialize the progress information in element 421. In one 
embodiment, processor 510 may store locations of sectors of file A being 
read in READ 1 . In another embodiment, processor 51 0 may add the address 
of element 421 into a preceding element (not shown) of the first list 420. 

[0028] In block 606, processor 51 0 may retrieve the progress information 
regarding a fragment, for example fragment X, of file A in element 421 . In one 
embodiment, processor 510 may obtain one or more locations corresponding 
to one or more sectors belonging to fragment X. Processor 510 may read 
fragment X according to the locations as obtained in block 606 (block 608). In 
one embodiment, processor 510 may find the locations as obtained in block 
606 and read fragment X therefrom. In block 610, processor 510 may update 
the progress information or data in element 421 in response to determining 

that the reading of fragment X is completed. In one embodiment, processor 
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510 may delete from element 421 the locations associated with fragment X. 
In block 612, processor 510 may determine whether there is any other 
fragment being read in READ 1. In one embodiment, processor 510 may 
determine all the fragment(s) of file A have been read, in response to 
determining that element 421 does not comprise a location of any sector 
being read, and processor 510 may remove element 421 for READ 1 from the 
first list 420 (block 614). In another embodiment, processor 510 may further 
update data structure 400 by removing element 416 if there is no more 
operation regarding file A. Conversely, processor 510 may continue to blocks 
606, 608, 610 and 612, in response to determining that there are one or more 
fragments being read in READ 1. In one embodiment, processor 510 may 
determine whether there are one or more fragments being read in READ 1 
based on the progress information or data of element 421 . Although the 
method of FIG. 6 is described with particular reference to FIG. 4, other 
embodiments may apply to a different operation on a different file or directory. 
[0029] An example method is illustrated in FIG. 7 that may be used by 

processor 510 to write a file or a directory in non-volatile memory 520. In one 
embodiment, processor 510 may establish in volatile memory 530 a data 
structure, such as 400, that may comprise one or more elements, wherein 
each element may record primary information on a file or a directory being 
operated. In another embodiment, processor 510 may build up in the volatile 
memory one or more lists, such as 420 and 430, that may be attached to each 
element of the data structure 400 and may comprise progress information on 
all concurrent operations on the file or the directory identified by each element. 
In yet another embodiment, instead of using one or more lists, processor 510 
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may combine elements in lists 420 and 430 in data structure 400 for all 
concurrent operations. The following description on the method of FIG. 6 may 
make reference to the embodiment of FIG. 4; however, other embodiments 
may adopt different data structures to track information on each concurrent 
operation. 

[0030] In block 702, processor 510 may create a new element for a WRITE 
operation, for example, WRITE 1. Referring to the embodiment of FIG. 4, 
processor 510 may create in data structure 400 a new element 416 that may 
comprise information on a file, for example file A, being operated in WRITE 1 , 
in response to determining that data structure 400 does not comprise an 
element regarding file A. In another embodiment, processor 510 may create 
in the first list 420 a new element 423 for WRITE 1 that may write one or more 
sectors of file A. Element 423 may be attached to element 416 of data 
structure 400. In yet another embodiment, processor 510 may combine 
elements 416 and 423 in the same data structure 400. In block 704, 
processor 510 may initialize the progress information in element 423. In one 
embodiment, processor 510 may store locations of sectors of file A being 
written in WRITE 1. In another embodiment, processor 510 may add the 
address of element 423 into a preceding element (not shown) of the first list 
420. 

[0031] In block 706, processor 51 0 may retrieve the progress information 

regarding a fragment, for example fragment X, of file A in element 423. In one 

embodiment, processor 510 may obtain one or more locations corresponding 

to one or more sectors belonging to fragment X. Processor 510 may write 

fragment X according to the locations as obtained in block 706 (block 708). In 

14 



block 710, processor 51 0 may determine whether any sector or non-fragment 
unit or fragment replacement occurs during writing fragment X. For example, 
in response to determining that one or more sequence table associated with 
fragment X and/or fragment X are moved to one or more new physical 
locations (such as sector locations or non-fragment unit locations), processor 
510 may update all elements of file A in the first list 420 relating to the location 
replacement with the one or more new locations (block 712). In one 
embodiment, processor 510 may replace one or more original sector 
locations in the first list 420 by corresponding new locations according the 
location moving. In block 714, processor 510 may update the progress 
information or data in element 423 in response to determining that the writing 
of fragment X is completed. In one embodiment, processor 510 may delete 
from element 423 the locations associated with fragment X. 
[0032] In block 716, processor 510 may determine whether there is any other 
fragment being written in WRITE 1 . In one embodiment, processor 51 0 may 
determine all the fragment(s) of file A have been written, in response to 
determining that element 423 does not comprise a location of any sector 
being written, and processor 51 0 may remove element 423 for WRITE 1 from 
the first list 420 (block 718). In another embodiment, processor 510 may 
further update data structure 400 by removing element 416 if there is no more 
operation regarding file A. Conversely, processor 510 may continue to blocks 
706, 708, 710, 712, 714 and 716, in response to determining that there are 
one or more fragments being written in WRITE 1 . In one embodiment, 
processor 510 may determine whether there are one or more fragments 
being written in WRITE 1 based on the progress information/data of element 

15 



423. Although the method of FIG. 7 is described with particular reference to 
FIG. 4, other embodiments may apply to a different operation on a different 
file or directory. 

[0033] While the methods of FIGs. 6 and 7 are illustrated as a sequence of 
operations, processor 510 in some embodiments may perform illustrated 
operations of the method in a different order. In one embodiment, processor 
510 may perform one or more concurrent operations simultaneously 
according to FIG. 6 and/or FIG. 7. In another embodiment, according to data 
structure 400, processor 510 may detect whether there is a high priority 
operation on a file or directory in all concurrent operations on the same file or 
directory before performing any of the concurrent operations. If processor 
510 detects that there is such a high priority operation, processor 510 may 
perform the high priority operation according to FIGs. 6 or 7 first. Processor 
510 may perform other concurrent operations after the completion of the high 
priority operation. In another embodiment, processor 510 may perform such 
detection during performing one of the concurrent operations. In response to 
detecting such a high priority operation, processor 510 may perform the high 
priority operation after completing the one concurrent operation on a 
fragment of the file or directory and processor 510 may continue the one 
concurrent operation on remaining fragment(s) of the file or directory upon 
the completion of the high priority operation. 
[0034] In one embodiment, processor 510 may generate a new element in 
data structure 400 for each concurrent operation before performing any of the 
concurrent operations. For example, blocks 602 and 702 may be omitted 
from FIGs. 6 and 7, respectively. For example, a new element may comprise 
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information on a file or directory to be operated by a concurrent operation and 
progress information/data about the concurrent operation. In addition, data 
structure 400 may also comprise link information/data to link elements 
relating to the same file or directory. In another embodiment, processor 510 
may add one or more elements that may each identify a file or directory being 
operated by the concurrent operations. In another embodiment, processor 
510 may record progress information/data for each of the concurrent 
operations in a corresponding element of the data structure 400. In yet 
another embodiment, processor 510 may record progress information/data 
for each operation as lists, etc. In one embodiment, processor 510 may 
perform initialize the progress information/data before executing any of the 
concurrent operations. For example, blocks 604 and 704 may be omitted 
from FIGs. 6 and 7, respectively. 
[0035] While certain features of the invention have been described with 
reference to embodiments, the description is not intended to be construed in 
a limiting sense. Various modifications of the embodiments, as well as other 
embodiments of the invention, which are apparent to persons skilled in the art 
to which the invention pertains are deemed to lie within the spirit and scope of 
the invention. 
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